L Number 


Hits 


Search Text 


DB 


Time stamp 




30671 


hierarch$5 and selections 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


.23 




844 


(hierarch$5 and selections) and tag$3 
near2 (attribut$3 or nod$3 or group or 
categor$5) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


24 




844 


(hierarch$5 and selections) and (tag$3 
near2 {attribut$3 or nod$3 or group or 
categor$5) ) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


24 




67 


( (hierarch$5 and selections) and (tag$3 
near2 {attribut$3 or nod$3 or group or 
categor$5) ) ) and "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


24 




38 


( ( (hierarch$5 and selections) and {tag$3 
near2 (attribut$3 or nod$3 or group or 
categor$5) ) ) and "start time") and 
duration 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


25 




10 


( ( ( (hierarch$5 and selections) and (tag$3 
near2 (attribut$3 or nod$3 or group or 
categor$5) ) ) and "start time") and 
duration) and authority 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


27 




10 


{ ( ( ( (hierarch$5 and selections) and {tag$3 
near2 (attribut$3 or nod$3 or group or 
categor$5) ) ) and "start time") and 
duration) and authority) and {update or 
delet$3 or add$3 or modif$5) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


28 




10 


( ( ( (hierarch$5 and selections) and (tag$3 
near2 {attribut$3 or nod$3 or group or 
categor$5) ) ) and "start time") and 
duration) and authorit$3 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


27 




15609 


tag$5 same value 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13 


29 
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(tag$5 same value) and hierarch$5 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13' 


29 




3191 


( (tag$5 same value) and hierarch$5) and ( 
edit$3 or delet$5 or add$3 or updat$3) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13: 


30 
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( ( (tag$5 same value) and hierarch$5) and ( 
edit$3 or delet$5 or add$3 or updat$3) ) 
and (assign$ same tag$3) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13: 


31 




45333 


( { { ( (tag$5 same value) and hierarch$5) and 
( edit$3 or delet$5 or add$3 or updat$3) ) 
and (assign$ same tag$3) ) and multi-level) 
amd "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


13: 


32 ' 

/ 




3 


( ( ( ( (tag$5 same value) and hierarch$5) and 
( edit$3 or delet$5 or add$3 or updat$3) ) 
and (assign$ same tag$3) ) and multi-level) 
and "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 : 


41 
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bit -map 
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US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:41 




3126932 


bit-map and tag$3 (value or attribut$3 or 
node) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 
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bit-map and (tag$3 same (value or 
attribut$3 or node) ) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 
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(bit-map and (tag$3 same (value or 
attribut$3 or node) ) ) and "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
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14 
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(bit-map and (tag$3 same (value or 
attribut$3 or node) ) ) and duration 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:45 
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( ( ( (tag$5 same value) and hierarch$5) and 
( edit$3 or delet$5 or add$3 or updat$3) ) 
and (assign$ same tag$3) ) and multi-level 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:47 




0 


{ (bit -map and (tag$3 same (value or 
attribut$3 or node) } ) and duration) and 
{ { ( ( (tag$5 same value) and hierarch$5) and 
{ edit$3 or delet$5 or add$3 or updat$3)) 
and (assign$ same tag$3) ) and multi-level) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT ; 
IBM TDB 
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14 


:47 
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add$3 or updat$3) ) and (assign$ same 
tag$3) ) and multi-level) 
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mpeg-7 and (tag$3 attribut$3) 
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14 
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77 


(mpeg-7 and (tag$3 attribut$3) ) and 
duration 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:51 




22 


((mpeg-7 and (tag$3 attribut$3)) and 
duration) and "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:52 




9397 


duration and "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
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2004/03/01 


14 


:52 
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(duration and "start time") and (audio or 
viedo) 
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US-PGPUB; 
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14 
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((duration and "start time") and (audio or 
viedo)) and (tag$3 same attribute) 
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US-PGPUB; 
EPO; JPO; 
DERWENT; 
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2004/03/01 


14 
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50 


{{(duration and "start time") and {audio 
or viedo) ) and (tag$3 same attribute) ) and 
hierarch$5 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:53 




50 


(({(duration and "start time") and (audio 
or viedo) ) and (tag$3 same attribute) ) and 
hierarch$5) and select$5 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:54 




50 


(((((duration and "start time") and (audio 
or viedo) ) and (tag$3 same attribute) ) and 
hierarch$5) and select$5) and (execut$5 or 
process) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:54 




0 


((((((duration and "start time") and 
(audio or viedo)) and (tag$3 same 
attribute) ) and hierarch$5) and select$5) 
and (execut$5 or process) ) and assing$3 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:54 




49 


((((((duration and "start time") and 
(audio or viedo) ) and (tag$3 same 
attribute) ) and hierarch$5) and select$5) 
and (execut$5 or process}) and assign$3 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT ; 
IBM TDB 


2004/03/01 


14 


:55 




12 


(((((( (duration and "start time") and 
(audio or viedo) ) and (tag$3 same 
attribute) ) and hierarch$5) and select$5) 
and (execut$5 or process}) and assign$3) 
and (parallel same tag$3) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT ; 
IBM TDB 


2004/03/01 


14 


:57 
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assign$ near tag$3 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


:57 




285 


(assign$ near tag$3) and (execut$3 same 
command) 


USPAT; 
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DERWENT; 
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2004/03/01 


14 
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77 


( {assign$ near tag$3) and (execut$3 same 
command) ) and duration 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


58 




6 


( ( (assign$ near tag$3) and (execut$3 same 
command) ) and duration ) and "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


14 


58 
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hierarch$5 and (select$3 with option) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


16 


49 




251 


(hierarch$5 and (select$3 with option) ) 
and (tag same selection) 
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128 


( (hierarch$5 and {select$3 with option)) 
and (tag same selection) ) and (audio or 
viedo) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


16 


:49 




15 


( ( (hierarch$5 and (select$3 with option) ) 
and (tag same selection) ) and (audio or 
viedo) ) and "start time" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/01 


16 


:50 




12 


( ( ( (hierarch$5 and (select$3 with option)) 
and (tag same selection) ) and (audio or 
viedo)) and "start time") and download$3 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


10 


:10 




1 


( ( ( ( (hierarch$5 and (select$3 with 
option) ) and (tag same selection) ) and 
(audio or viedo) ) and "start time") and 
download$3) and ((online same catalog) or 
(online same shopping) ) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


10 


10 




1 


( ( ( ( (hierarch$5 and (select$3 with 
option) ) and (tag same selection) ) and 
(audio or viedo)) and "start time") and 
download$3) and (online same catalog) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


10 


11 




0 


( ( ( ( (hierarch$5 and (select$3 with 
option) ) and (tag same selection) ) and 
(audio or viedo)) and "start time") and 
download$3) and (online same shopping) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


10 


11 




2 


"20030212992" 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


10 


11 




0 


"20030212992" and hierarch$5 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT ; 
IBM TDB 


2004/03/03 


10 


11 
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"20030212992" and multi-level 
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US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 
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14 
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"20030212992" and select$5 
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US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


10 


26 




0 


("20030212992" and select$5) and duration 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


11 


03 




1 


("20030212992" and select$5) and (store or 
save) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT ; 
IBM TDB 


2004/03/03 


11 


59 




0 


(("20030212992" and select$5) and (store 
or save) ) and xml 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


11: 


59 




0 


(("20030212992" and select$5) and (store 
or save) ) and xsd 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 
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04 



Search History 3/3/04 1:38:10 PM Page 4 
C:\APPS\east\workspaces\09904176 .wsp 





0 


MPEG 


with xml 


with xsd 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


12 


05 




15 


MPEG 


and (xml 


and xsd) 


USPAT; 
US-PGPUB; 
EPO; JPO; 
DERWENT; 
IBM TDB 


2004/03/03 


12 


05 



Search History 3/3/04- 1:38:10 PM Page 5 
C: \APPS\east\workspaces\09904176 . wsp 



liiiyHiiiiiininiiiiniiH 

US 20020085028A1 

(19) United States 

(12) Patent Application Publication m Pub. No.: US 2002/0085028 Al 

Tabatabai et al. (43) Pub. Date: Jul, 4, 2002 



(54) COMMAND DESCRIPTION SCHEME 

PROVIDING FOR DYNAMIC UPDATE OF 
INSTANCE DOCUMENTS AND THEIR 
ASSOCIATED SCHEMA 

(76) Inventors: AH Tabatabai, Beaverton, OR (US); 

Hawley K. Rising, San Jose, CA(US) 

Correspondence Address: 

WAGNER, MURABITO & HAO LLP 

Third Floor 

Tow North Market Street 
San Jose, CA 95113 (US) 

(21) Appl. No.: 09/865,030 

(22) Filed: May 24, 2001 

Related U.S. Application Data 

(63) Non-provisional of provisional application No. 
60/208,121, filed on May 30, 2000. 



Publication Classification 

(51) Int. CI. 7 G06F 15/00 

(52) U.S. CI 345/748; 345/501 



(57) 



ABSTRACT 



The present invention provides a method and system for 
dynamically updating descriptions of AV content, such as 
MPEG-7 content descriptions. One embodiment provides 
for a method in which first a server issues a command 
indicating the type of update to make to the description on 
a client computer. Specifically, the update may be to add, 
delete, or change a node in a tree or graph structure 
describing the AV content. For example, the command may 
specify an update to an instance document or its associated 
schema. The server also specifies the location in the descrip- 
tion to perform the update, which may be at an absolute or 
relative address. Next, the server sends the data, if any, to be 
added or used for the change. Embodiments also provide for 
steps to check that the update is authorized. 
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COMMAND DESCRIPTION SCHEME PROVIDING 

FOR DYNAMIC UPDATE OF INSTANCE 
DOCUMENTS AND THEIR ASSOCIATED SCHEMA 

RELATED U.S. APPLICATION 

[0001] This Application claims priority to U.S. Provi- 
sional Application entitled, "Proposed Schema for Com- 
mandDS," Application No. 60/208,121, filed on May 30, 
2000, which application is hereby incorporated by reference. 

FIELD OF THE INVENTION 

[0002] The present invention relates to the field of coding 
of moving pictures and associated audio. Specifically, the 
present invention relates to a method for dynamically updat- 
ing descriptions of audio-visual content by providing for a 
command schema which allows for additions, deletions, and 
changes to the nodes in instance documents and their 
associated schema. 

BACKGROUND ART 

[0003] In recent years applications such as the Internet 
have allowed for dramatic changes in the way information, 
such as audio visual (AV) multimedia content, may be 
accessed and worked with. Examples which are suggested 
are allowing user interaction with audio visual (AV) multi- 
media content, as well as searches and queries based on the 
AV content. Further examples include allowing a user to 
request information (such as restaurants in the user's loca- 
tion) or to change the viewpoint from which a video scene 
is viewed. 

[0004] To facilitate such processing, the AV content may 
have an associated description of the content. One technique 
to describe such AV content is presented in the MPEG-7 
standard otherwise known as "Multimedia Content Descrip- 
tion Interface", an ISO/IEC standard developed by the 
Moving Picture Experts Group (MPEG). At the lowest level 
of description, the MPEG-7 standard may use 'Descriptors' 
which represent low-level AV features, such as signal ampli- 
tude, frequency, and spectral tilt. A schema language, such 
as the Data Description Language (DDL) may be used to 
represent the results of modeling audiovisual data. The DDL 
specifies the syntax for creating Description Schemes from 
the Descriptors. The description of the AV information may 
be accomplished with a hierarchical tree structure or a graph 
structure, depending on the nature of the information. 

[0005] Another conventional technique of describing 
audiovisual multimedia content are key frames. Key frames 
are useful for creating summaries of video, for allowing near 
random access to video, for comparing video, and for 
referring to video in print. However, most implementations 
of key frames are static, consisting of a single list of the key 
frames related to some quantization of the video sequence, 
such as a sequential segmentation into shots or scenes. 

[0006] Unfortunately, for a very large piece of audiovisual 
content, re -sending descriptions of the content (or key 
frames) for a fine grained quantization, such as individual 
shots may be unfeasible due to bandwidth limitations. For 
example, if the average shot length in a two hour feature film 
length movie is ten seconds, the required set of shots would 
be 6000 key frames. Assuming a transmission rate of 30 
frames per second, it would lake 3.3 minutes to re -send the 
key frames. Unfortunately, this is not within an interactive 
response range. 



SUMMARY OF THE INVENTION 

[0007] Therefore, it would be advantageous to provide a 
method for dynamically updating audio-visual content 
descriptions. A still further need exists for a technique which 
allows AV content descriptions which are compliant with an 
industry standard, such as MPEG-7, to be dynamically 
updated. A further need exists for a technique which allows 
such updates to be performed in real time for a user 
connected to a server at conventional speeds, thus allowing 
for interactive processing. An even further need exists for 
such a technique which allows updates to be performed 
either 'on-the-fly' based on user requests or using pre- 
processed information to provide the information for the 
update. 

[0008] The present invention provides a method and sys- 
tem for dynamically updating descriptions of AV content. 
The descriptions may be, for example, compliant with the 
MPEG-7 standard. One embodiment provides for a method 
in which first a server issues a command indicating the type 
of update to make to the description on a client computer. 
Specifically, the update may be to add, delete, or change a 
node in a tree or graph structure describing the AV content. 
For example, the command may specify an update to an 
instance document or its associated schema. The server also 
specifies the location in the description to perform the 
update, which may be at an absolute or relative address. 
Next, the server sends the data, if any, to be added or used 
for the change. Embodiments also provide for steps to check 
that the update is authorized. The client may need to have 
authorization for the requested update and the server may 
need to have authorization to perform the update. 

[0009] The update may be made to the structure of the 
description, for example, the schema. Alternatively, the 
update may be made to a parameter at a node in the structure, 
for example, instance information is updated. The step of 
specifying the location of the update may specify an abso- 
lute or local address in the description. 

[0010] In one embodiment, adding to the description is 
accomplished by deriving by extension, deleting is accom- 
plished by a deriving by restriction, and changing the 
description is accomplished by a combination of the two. 
[0011] The update to the description may be made from 
information which is stored on the server. Alternatively, the 
update may be made 'on-the-fly' by altering the description, 
for example, altering the shot identification or scene iden- 
tification. 

[0012] Yet another embodiment provides for a computer 
readable medium which has instructions stored thereon for 
updating MPEG-7 audio-visual content descriptions. The 
instructions may be referred to as a Command Description 
Scheme (CommandDS). The instructions comprise a com- 
mand structure for specifying the type of update, for 
example, add, delete, or change. The instructions also 
specify the location of the update, and whether the update is 
authorized. 

[0013] The present invention provides these advantages 
and others not specifically mentioned above but described in 
the sections to follow. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0014] FIG. 1 is a diagram of an exemplary system for 
updating MPEG-7 audio-visual content descriptions, 
according to an embodiment of the present invention. 
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[0015] FIG. 2 is a flowchart illustrating the steps of a 
process of dynamically updating descriptions of MPEG-7 
content, according to an embodiment of the present inven- 
tion. 

[0016] FIG. 3A and FIG. 3B are diagrams illustrating a 
UML representation of a Command Description Scheme, 
according to an embodiment of the present invention. 

[0017] FIG. 4 is a schematic of a computer system, which 
may be used to implement embodiments of the present 
invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

[0018] In the following detailed description of the present 
invention, a method and system for dynamically updating 
instance documents, as well as their associated schema, 
numerous specific details are set forth in order to provide a 
thorough understanding of the present invention. However, 
it will be recognized by one skilled in the art that the present 
invention may be practiced without these specific details or 
with equivalents thereof. In other instances, well known 
methods, procedures, components, and circuits have not 
been described in detail as not to unnecessarily obscure 
aspects of the present invention. 

Notation and Nomenclature 

[0019] Some portions of the detailed descriptions which 
follow are presented in terms of procedures, steps, logic 
blocks, processing, and other symbolic representations of 
operations on data bits that can be performed on computer 
memory. These descriptions and representations are the 
means used by those skilled in the data processing arts to 
most effectively convey the substance of their work to others 
skilled in the art. A procedure, computer executed step, logic 
block, process, etc., is here, and generally, conceived to be 
a self-consistent sequence of steps or instructions leading to 
a desired result. The steps are those requiring physical 
manipulations of physical quantities. Usually, though not 
necessarily, these quantities take the form of electrical or 
magnetic signals capable of being stored, transferred, com- 
bined, compared, and otherwise manipulated in a computer 
system. It has proven convenient at times, principally for 
reasons of common usage, to refer to these signals as bits, 
values, elements, symbols, characters, terms, numbers, or 
the like. 

[0020] It should be borne in mind, however, that all of 
these and similar terms are to be associated with the appro- 
priate physical quantities and are merely convenient labels 
applied to these quantities. Unless specifically stated other- 
wise as apparent from the following discussions, it is appre- 
ciated that throughout the present invention, discussions 
utilizing terms such as "indexing" or "processing" or "com- 
puting" or "translating" or "calculating" or "determining" or 
"scrolling" or "displaying" or "recognizing" or "generating" 
or the like, refer to the action and processes of a computer 
system, or similar electronic computing device, that manipu- 
lates and transforms data represented as physical (electronic) 
quantities within the computer system's registers and memo- 
ries into other data similarly represented as physical quan- 
tities within the computer system memories or registers or 
other such information storage, transmission or display 
devices. 



Command Description Scheme Providing for 
Dynamic Update of Instance Documents and Their 
Associated Schema 

[0021] The present invention provides for a method and 
system for dynamically updating instance documents, as 
well as their associated schemas. The present invention is 
suitable for updating documents which describe AV content 
and are compliant with the MPEG-7 standard. 

[0022] Embodiments of the present invention are opera- 
tional in a server/client environment. Referring now to FIG. 
1, a server 202a is shown transferring audio-visual content 
216 and an associated description 206 of that content 216 to 
a client 204. Embodiments of the present invention provide 
a technique for updating the description 206, which may 
occur in response to, for example, client 204 interaction with 
the content 216, client 204 searches or queries based on the 
content 216, or client 204 preferences. For example, the 
client 204 may wish to view a video scene from a different 
angle. 

[0023] The audio-visual descriptions 206, which embodi- 
ments of the present invention dynamically update, are 
constructed by using the Data Description Language (DDL), 
in the preferred embodiment. When using DDL to describe 
AV content 216, the audio -visual descriptions 206 may form 
a tree -structure, such as the ones on the client 204 and 
servers 202 in FIG. 1. The description 206 may be formed 
by a DDL parser. The various nodes 208 of the tree contain 
information describing a portion of the AV content 216, such 
as its color, motion, shape, texture, etc. For example, if the 
AV content 216 is of a soccer match, the description 206 
may describe the color of the players* uniforms, personal 
information about the players, and the rules of soccer. As a 
further example, one node 208 may describe the entire 
soccer ball, another node 208 a player's head, etc. In this 
fashion, a single motion vector may be associated with a 
given node 208, although this is not required. It will be 
understood by those of ordinary skill in the art that the 
description 206 may have any number of nodes 208. Fur- 
thermore, the description 206 need not be hierarchical For 
example, the description 206 may be in the form of a graph 
rather than a hierarchical tree structure. For example, the 
graph may be organized as a group of nodes 208 and a group 
of edges relating the nodes 208. Finally, while the trees are 
illustrated as binary trees, the present invention is well suited 
to updating non-binary trees. 

[0024] The description 206 in FIG. 1 may represent a 
particular instantiation 2066 (e.g., instance document) cor- 
responding to a particular schema 206a. The schema 206a 
may be written in DDL and may be a tree structure (or 
alternatively a graph structure). Importantly, the updates 
may take place to either the schema 206a or the instance 
document 2066. An update to the schema 206a may corre- 
spond to a structural change from, for example, a ball to a 
person. An update to the instance document 2066 may 
correspond to an informational change, for example, a 
change of the ball's color. It will be understood that an 
update to an AV content description 206 may be accom- 
plished by updating an instance document 2066 or its 
associated schema 206a or the like. 

[0025] The MPEG-7 standard may use the DDL program- 
ming language to describe audio-visual content 216. An 
Extensible Markup Language (XML) based schema lan- 
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guage, such as the Data Description Language may be used 
lo represent the results of modeling audiovisual data. The 
DDL specifies the syntax for creating Description Schemes 
(DS) from the Descriptors. Embodiments of the present 
invention provide for a Command Description Scheme 
(CommandDS), which may be used to make updates to the 
audio-visual descriptions 206. While the preferred embodi- 
ment updates MPEG-7 content descriptions 206, the present 
invention is not limited to updating MPEG-7 descriptions 
206. Furthermore, while the preferred embodiment updates 
documents described in DDL, the present invention is not 
limited to updating documents written in DDL. 

[0026] In order to efficiently make such updates, the server 
202 does not need to transfer an entire new description 206 
of the content 216. Instead the server 202a transfers a series 
of commands and data, such that the client 204 may update 
the description 206. For example, if the description 206 is 
constructed as a tree structure, nodes 208 may be deleted, 
added, or changed. Furthermore, information at a node 208 
may be changed. 

[0027] The updates may be generated in two ways. First, 
the server 202 has stored on it pre-processed descriptions 
206/? that may be used for updates such as a user request for 
information about local restaurants. Second, the update may 
be performed 'on-the-fly\ For example, the client 204 or 
another process on the server 202 may send a request to 
change a scene. The server 202 will send commands and 
data to the client 204 so that the description 206 may be 
updated. The client 204 may receive updates from multiple 
servers, such as server 202b through server 202/a. The 
present invention is also well suited to a peer-to-peer system 
or a broadcast system. Furthermore, embodiments allow for 
both push and pull operations. 

[0028] Furthermore, dynamically updating the audio-vi- 
sual descriptions 206 may be performed in at least three 
ways, adding deleting, or changing. For example, server 
202b may send a document fragment 206c to be added to the 
tree structure before or after a target node 208. Nodes may 
be deleted from the tree structure, or the nodes 208 of the 
tree structure may be changed. Furthermore, the information 
(e.g., a color descriptor) at a node 208 may be changed. 

[0029] In the preferred embodiment, the parser that creates 
the description trees is an XML Path Language/XML 
Pointer Language (XPath/XPointer) aware parser. Thus, the 
absolute and relative location of the nodes 208 in the tree are 
identified by the triple (e.g., axis, nodetest, and predicate) 
constructs. These are attached as fragment modifiers to a 
Uniform Resource Locator (URI) address. For example, 
"po.xml#items/child::item[positions( )=l]/attribute::part- 
Num is a valid XPath expression that selects the PartNum 
attribute of the first child <item> of <items>." The XPo inter 
extends to XPath by introducing point and range concepts as 
positional declarations within a document. A suitable parser 
is described in "XML Path Language (XPath), World Wide 
Web Consortium, W3C Proposed Recommendation," and 
"XML Pointer Language (XPointer), World Wide Web Con- 
sortium, W3C Working Draft." 

[0030] An embodiment of the present invention takes the 
following approach to accomplish the dynamic update to the 
tree or graph. A delete operation corresponds lo deriving a 
new type by restriction and an add operation corresponds to 
deriving by extension. A parent schema 206fl is derived from 



a source schema 206a by using 'constraint* value for 
'derivedBy* attribute with the base as the source schema 
206a. The list of constraints has a one-to-one mapping, with 
the list of delete operations. Similarly, the parent node 208 
is extended to a new schema 206a by assigning 'extension 1 
value to 'derivedBy' attribute with the base as the parent 
schema 206a. In this case, the list of extensions has a one-to 
one mapping with the list of add operations. 

[0031] Furthermore, a change operation may be accom- 
plished by a combination of derive by extension and derive 
by restriction. For example, if a node 208 which is internal 
to the tree is to be changed, first a delete operation is done, 
followed by an add operation. In one embodiment, docu- 
ment fragments are created on the receiving (e.g., client 204) 
side, then a node 208 is deleted. Finally, document frag- 
ments are added back to the tree. However, the change 
operation may be performed by other combinations of add 
and delete commands. For example, the tree below the 
deleted node 208 may be re-created. 

[0032] After the update has been accomplished, the XML 
parser may check the validity and well formedness against 
the source schema 206a and throw an exception if an invalid 
operation is detected. Th rowing an exception may be used as 
a signal to generate a new schema 206a. 

[0033] An embodiment provides for flags to indicate 
whether the changes made to the source document and 
accordingly to the schema 206a should be reflected in 
separate ".xml" and "xsd" files. 

[0034] The steps of a process of dynamically updating 
audio- visual descriptions 206 are described in FIG. 2. The 
steps of the process may be executed on a general purpose 
computer such as the one illustrated in FIG. 4. When an 
update is required the server 202 determines how the 
description 206 needs to be re-configured and where the 
data, if any, to be sent to the client 204 is stored. The process 
may be repeated as many times as necessary to update the 
entire description 206. In step 405, the server 202 provides 
its authorization to make the updates to the client 204. This 
step need not be repeated if multiple update commands are 
sent. 

[0035] In step 410, the server 202 sends a command which 
indicates the type of update which is to be made to the AV 
description 206 (e.g., description schema 206a or descrip- 
tion instance document 2066). For example, this command 
specifies whether to add, delete, or change a node 208. The 
command may take various forms including, but not limited 
to the XML implementation or DTD implementation defined 
herein. 

[0036] In step 415, the server 202 sends the location 
within the description 206 for the update to the client 204. 
This may be specified as either an absolute or as a relative 
address. A relative address may be useful for allowing a 
server 202 which does not has knowledge of only a portion 
of the description 206 to direct an update. Furthermore, the 
update may be before or after a target node 208. 

[0037] In step 420, the server 202 sends the data to be 
added or to be used in the change. A part of the data may be 
a URI reference, for example, a reference to a schema 206a. 
The data may be stored on the server 202 or generated 
on-the-fly. It is not required that data be sent, for example, 
if the update is a delete. 
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[0038] As step 425 describes, if the command is to add to 
the description 206, the client 204 will add a node 208 to the 
tree or graph using the data, along with the absolute or 
relative address provided by the server 202. In an embodi- 
ment using XML, the add is accomplish via an derive by 
extension. 

[0039] If instead, the command is a delete, then the client 
204 need only delete the node 208, in step 430. In an 
embodiment using XML, the delete is accomplish via an 
derive by restriction. 

[0040] If a change command is specified, the process is 
slightly more complex. Starting in step 435, the client 204 
saves tree fragments below the location of the node 208 to 
be changed. Then, in step 440, the client 204 deletes the 
node 208 at the change location. 

[0041] Next, in step 445, the client 204 adds a new node 
208 at the change location. The client 204 uses the data sent 
from the server 202 to fill in the various elements, and 
parameters at this node 208. 

[0042] Finally, in step 450, the client 204 adds the saved 
tree fragments back to the tree below the added node 208. 
Thus, a change to the specified node 208 is accomplished. 
The change may be accomplished by other combinations of 
add and delete commands. 

[0043] While process describes the process as between a 
server 202 and a client 204, it will be understood that the 
process may take place in the upstream direction, as well. 
Furthermore, the present invention is well suited to both 
broadcast and peer-to-peer contexts. 

Exemplary XML CommandDS Schema 

[0044] In one embodiment, a command DS schema is 
providing for and is constructed in the XML programming 
language. The CommandDS schema may be used to update 
AV content descriptions 206. It will be understood that the 
CommandDS schema is not the same schema 206 as shown 
in FIG. 1 to describe the AV content 216. The CommandDS 
schema is comprised of several Complex Types and Simple 
Types. After an initial simple type "listOffiyte", the Com- 
mandDS schema has a simple type for "commandType" 
providing for add, delete, and change commands. 



-continued 



<c numeration value»"add'7> 
e numeration valueo"delete"/> 
<e numeration value="change'7> 
. </simpleType> 



[0045] The update to the AV description 206 may be 
executed before or after a specified node 208. The following 
simple type of the CommandDS allows for this. 



<simpleType name="insertPosition" base="string"> 

enumeration value-"before'7> 

enumeration value-"after7> 
</simpleiype> 



[0046] The command DS also allows for selecting non- 
MPEG-7 data as the following simple and complex types 
describe. 



<simpleType narne="binflTyContentType" base="NOTATION"> 

enumeration value-"xmlbin"/> 

<enume ration value-"bifs'7> 

<enume ration value-" mp4"/> 
</simpleType> 

eomplexType name- "VeotorB" base- "listOfByte" derivedBy- 
"extension"> 

attribute name- "size" type= "nonNegativeInteger"/> 
</complexType> 



[0047] In order to prevent an un-authorized updates to the 
AV content description 206, the CommandDS schema pro- 
vides for a complex type that allows authorization to be 
checked, as follows: 



<complexTypc name- "authorityLevei"> 

<atlribute name- "primary Key" type- "integer7> 
<attribute name- "secondaryKey" type- "integer"/> 
ottribute name- "level" type= "integer*7> 

</complexType> 



■csimpleType name-" lis tOfByte" base="unsignedByte" derivedBy="list M /> 
<simpleType name=" commandType" base-"string"> 



[0048] The CommandDS Schema also has a complex type 
for the data to be added or changed in the AV content 
description 206, as follows: 



<complexType name- "nodeVa!ue"> 
<choice> 

element name- "binary Value"> 
</complexType> 

element name- "node Name" type- "string" minOccurs- "0" 

maxOccurs-"17> 
element name- "schemaLocation" type- "uriReference"/> 
element name- "value" type** "VectorB" /> 
ottribute name- "binaryType" type- "binaryContentType" use- 
optional' 7> 
</complexType> 
</element> 

element name- "ascii Value"> 
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-continued 



</complexType> 
<choice> 

<any namespace»##any minOccurs- "1" maxOccurs- 
"unbounded" processContent- "skip"/> 

<anyAttribute namespace- ##any minOccurs- "1" max Occurs- 
"unbounded"/> 

<choice> 
</complexType> 
</element> 

<element name- "reference Value" type- "uriReference"/> 
<choice> 
</complcxTypc> 



[0049] 

follows: 



The Comma ndDS provides a Command Script as 



example, whenever a bifs notation is used a BIFS decoder is 
used. In this case, the following declaration is used: 



<complexType name- "commandScript"> 

<element name- "command" type- "command DS" minOccurs=> "1" 

maxOccurs- "unbounded"^ 
<attribute name- "authority" type- "authorityLevel" use- " required' V> 
<attribute name- "writeXML" type- "boolean" use- "default" value- 
"false'7> 

<attribute name- "rcsultXML" type- "uriRefercnce" use- "optional'7> 
cattribute name- "writeXSD" type- "boolean" use- "default" value- 
"false"/> 

<attribute name- "resultXSD" type- "uriRe fere nee" use- "optional"^ 
</complexType > 



[0050] Finally, a complex type of Command DS is pre- 
sented: 



[0055] <binaryContentType name='bifs' system* 
* bifsDecoder.exe V> 



<complexType name- "commandDS" > 

<element name- "value" type- "node Value" min Occurs- "0" 

maxOccurs- "1'7> 
<elemcnt name- "nextCommand" type- "commandDS" minOccurs- "0" 

maxOccurs- "unbounded' '/> 
ottiibute name- "sourceXML" type- "uriReference" use- "optIonal"/> 
ottribute name- "sourceXSD" type- "uriReference" use- "optionai'7> 
<attribute name- "select" type- "uriReference" use="required'7> 
<attribute name- "type" type- "commandType" use="required"/> 
ottribute name- "position" type- "insertPosition" use="default" value- 

"after"/> 
</complexType> 



[0051] This completes the description of the CommandDS 
schema. 

[0052] For binary values the attribute is called 'binary- 
ContentType', which is of the type 'NOTATION'. The 
parser will send the binary data associated with the notation 
to an appropriate decoder. The decoder may be identified by 
the following declaration, for example: 

[0053] <binaryContentType name-'xmlbin' system « 
'XMLB inaryDecoder.exe 7> 

[0054] The notation name used is 'xmibin\ Whenever the 
parser encounters such a notation name it sends its associ- 
ated binary data to be decoded by *XML BinaryDecoder*. 
The parser may also be instructed to deal with Non-XML 
data, such as MPEG-4 BIFS or MP4 based file formats. For 



Exemplary CommandDS DTD Schema 
Implementation 

[0056] The present invention is not limited to an XML 
CommandDS schema. A DTD based implementation of the 
CommandDS schema for dynamically updating AV content 
descriptions 206 follows: 



<! ELEMENT commandScript (commandDS+)> 

<! ELEMENT commandDS (childRef, (ascii Value | binary , Value | 

reference Value) )> 
<! ELEMENT childRef (reference | number)> 
<! ELEMENT reference EMPTY> 
<!ATTLIST childReference IDREF #REQUIRED> 
<! ELEMENT number EMPTY> 
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-continued 

<! This tells us which child number of the parent> 

<!A'ITLIST childNumber NMTOKEN #REQUIRED> 

<! ELEMENT asciiValue ANY> 

<! ELEMENT re fere nee Value EMPTY> 

<!ATTLIST reference Value ref IDREF #REQUIRED> 

<! ELEMENT binary Value EMPTY> 

<!ATTLIST binary Value value NOTATION (xmlbin, bifs, mp4, mpeg) 
"xmlbin"> 

<! NOTATION xmlbin SYSTEM "xmlBinaryDecoder.exe"> 

<! NOTATION bifs SYSTEM "bifcDecoder.exe"> 

<!ATTLIST commandDS comma ndType (add | delete | change)> 

<!ATTLIST commandDS parcntRef IDREF #REQUIRED> 

<! ATTLIST commandDS position (before | after) #DEFAULT "after"> 



[0057] Although a way to check authorization is not 
shown in the DTD exemplary implementation, the exem- 
plary DTD implementation may be modified to provide for 
all of the functionality that the XML based implementation 
has. 

[0058] While the present invention has been described in 
the context of updated MPEG-7 descriptions 206, the 
present invention may be used as the foundation for creating 
an XSL-like language for editing and authoring XML docu- 
ments. 

[0059] In order to more fully appreciate embodiments of 
the present invention, a Unified Modeling Language (UML) 
description of an embodiment of the present invention is 
shown in FIG. 3A and FIG. 3B. The UML description of the 
invention may be useful to understand the relationship 
between the various data structures of the CommandDS. It 
will be understood that the notation in FIG. 3A and FIG. 3B 
is to be read according to UML constructs. For example, the 
arrows with a diamond at one end in FIG. 3A show that 
commandType 302, node value 304, insertPosition 306, and 
authority level 308 are aggregates of the CommandDS 310. 
CommandDS 310 is within the Command Script 312. To the 
side, Vector B 314 is a subclass if the superclass list of Bytes 
316. 

[0060] FIG. 3B illustrates elements within node Value 
304. For example, the referenceValue 324, textual Value 326 
and binaryvalue 328. The textual value 326 is, in turn, 
composed of any namespace 332 and any attribute 334. The 
binaryvalue 328 is itself composed of node name, schema 
Location, and a value. 

[0061] The binary Value 328 contains binary Co ntcntTypc 
314, which may be xmlbin, bifs, or mp4. 

[0062] FIG. 4 illustrates circuitry of computer system 100, 
which may form a platform for embodiments of the present 
invention. Computer system 100 includes an address/data 
bus 99 for communicating information, a central processor 
101 coupled with the bus for processing information and 
instructions, a volatile memory 102 (e.g., random access 
memory RAM) coupled with the bus 99 for storing infor- 
mation and instructions for the central processor 101 and a 
non-volatile memory 103 (e.g., read only memory ROM) 
coupled with the bus 99 for storing static information and 
instructions for the processor 101. Computer system 100 
also includes an optional data storage device 104 (e.g., a 
magnetic or optical disk and disk drive) coupled with the bus 
99 for storing information and instructions. 



[0063] With reference still to FIG. 4, system 100 of the 
present invention also includes an optional alphanumeric 
input device 106 including alphanumeric and function keys 
is coupled to bus 99 for communicating information and 
command selections to central processor unit 101. System 
100 also optionally includes a cursor control device 107 
coupled to bus 99 for communicating user input information 
and command selections to central processor unit 101. 
System 100 of the present embodiment also includes an 
optional display device 105 coupled to bus 99 for displaying 
information. A signal input/output communication device 
108 coupled to bus 99 provides communication with exter- 
nal devices. 

[0064] The preferred embodiment of the present invention 
a method and system for dynamically updating instance 
documents and their associated schemas is thus described. 
While the present invention has been described in particular 
embodiments, it should be appreciated that the present 
invention should not be construed as limited by such 
embodiments, but rather construed according to the below 
claims. 



We claim: 

1. A method for dynamically updating descriptions of 
audio-visual content information, comprising the steps of: 

a) issuing a command indicating the type of update; 

b) specifying the location in said description to perform 
said update, wherein said description is substantially 
compliant with the MPEG-7 standard; and 

c) updating said description. 

2. The method of claim 1 further comprising the step of: 

d) determining whether said update is authorized to be 
performed. 

3. The method of claim 1 wherein said step a) comprises 
the step of: 

al) issuing a command to add to said description. 

4. The method of claim 1 wherein said step a) comprises 
the step of: 

al) issuing a command to delete a portion of said descrip- 
tion. 

5. The method of claim 1 wherein said step a) comprises 
the step of: 

al) issuing a command to change a portion of said 
description. 

6. The method of claim 1 wherein said step c) comprises 
the step of: 

cl) altering the structure of said description. 

7. The method of claim 1 wherein said step c) comprises 
the step of: 

cl) altering a parameter at a node of said description. 

8. The method of claim 1 wherein said step a) comprises 
the step of: 

al) issuing a derive by restriction command. 
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9. The method of claim 1 wherein said step a) comprises 
the step of: 

al) issuing a derive by extension command. 

10. The method of claim 1 further comprising the step of: 

d) transferring data to be added to said description. 

11. In a system comprising a first computer system and a 
second computer system coupled to said first computer 
system via a communication link and having stored thereon 
a description of audio-visual content that is formatted sub- 
stantially compliant with the MPEG-7 standard, a method 
for dynamically updating said description, comprising: 

a) said first computer system instructing said second 
computer system to perform a specified update to said 
description; 

b) said first computer system sending a location in said 
description for said update to said second computer 
system; and 

c) said second computer system updating said description. 

12. The method of claim 11 further comprising the step of: 

d) said first computer determining whether said update is 
authorized to be performed. 

13. The method of claim 11 further comprising the step of: 

d) said second computer system determining whether said 
first computer system is authorized to instruct said 
update. 

14. The method of claim 11 wherein said step a) com- 
prises the step of: 

al) issuing a command to add to said description. 

15. The method of claim 11 wherein said step a) com- 
prises the step of: 

al) issuing a command to delete a portion of said descrip- 
tion. 

16. The method of claim 11 wherein said step a) com- 
prises the step of: 

al) issuing a command to change a portion of said 
description. 

17. The method of claim 11 wherein said step c) com- 
prises the step of: 

cl) altering a schema of said description, wherein said 
description comprises a tree structure and said update 
modifies the tree-structure. 

18. The method of claim 11 wherein said step c) com- 
prises the step of: 



cl) altering instance information, wherein said descrip- 
tion comprises a tree structure and said update modifies 
a parameter at a node of the tree-structure, 

19. The method of claim 11 further comprising the step of: 

d) selecting among a set data stored on said first computer 
to update said description on said second computer. 

20. The method of claim 11 wherein said first and said 
second computer systems form a peer-to-peer system. 

21. The method of claim 11 wherein said step a) com- 
prises the step of: 

al) receiving a request from said second computer for 
information, wherein a pull operation is initiated. 

22. The method of claim 11 wherein said step a) com- 
prises the step of: 

al) determining that said description stored on said sec- 
ond computer should be updated, wherein a push 
operation is initiated. 

23. A computer readable medium residing on a first 
computer system having instructions stored thereon for 
causing a processor of said first computer system to instruct 
a processor of a second computer system to dynamically 
update an MPEG-7 audio- visual content description residing 
on said second computer system, said instructions compris- 
ing: 

a command structure for specifying the update for said 
description; and 

a location structure for specifying a location in said 
description to perform said update. 

24. The computer-readable medium of claim 23 wherein 
said command structure further specifies a command 
selected from the group consisting of add, delete, and 
change commands. 

25. The computer-readable medium of claim 23 wherein 
said location further specifies between a relative address in 
said description and an absolute address in said description. 

26. The computer-readable medium of claim 23 wherein 
said instructions further comprise a structure defining data to 
be added to said description. 

27. The computer-readable medium of claim 23 wherein 
said instructions further comprise a structure for specifying 
a security level to determine whether said update is allowed. 

28. The computer-readable medium of claim 23 wherein 
said instructions are substantially compliant with the Exten- 
sible Markup Language (XML). 

* * * * * 



03/03/2004, EAST Version: 1.4.1 



